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Abstract. We compute the number of circuits and of loops with multiple crossings 
in random regular graphs. We discuss the importance of this issue for the validity of 
the cavity approach. On the one side we obtain analytic results for the infinite volume 
limit in agreement with existing exact results. On the other side we implement a 
counting algorithm, enumerate circuits at finite N and draw some general conclusions 
about the finite N behavior of the circuits. 



PACS numbers: 02.10.Ox, 89.75.Hc, 05.40.-a 
1. Introduction 

The study of random graphs, initiated more than four decades ago, has been since an 
issue of major interest in probability theory and in statistical mechanics. Examples of 
random graphs abound pQ, from the original Erdos-Renyi model where edges are 
chosen independently of each other between pairs of a set of N vertices (with a fixed 
probability of 0(1/N)), to the scale-free graphs with power law degree distribution [Hj, 
only introduced in recent times. An interesting and useful distribution is the one that 
generates random c-regular graphs jlj. These are uniformly drawn from the set of all 
graphs over N vertices, each restricted to have degree c. Random regular graphs can be 
easily generated when N is large (and c finite) |5, , and an instance of 3-regular graph is 
symbolized in figure Q Around a randomly picked up vertex called root the graph looks 
like a regular tree. The probability that there exists a circuit (a self-avoiding closed 
path) of length L going through the root vanishes when N is sent to infinity and L is 
kept finite^ @j. 

The purpose of this article is to reach some quantitative understanding of the 
presence of long circuits in random graphs. Our motivation is at least two-fold. 

First, improving our knowledge on circuits in random graphs would certainly have 
positive fall-out on the understanding of equilibrium properties of models of interacting 

| More precisely, this probability asymptotically departs from zero when log A'' = O(L). Finite-length 
loops may be present in the graph, but not in extensive number. 
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Figure 1. Structure of a random regular graph with degree c = 3. In the vicinity of 
a vertex (the root) the graph looks like a (regular) tree attached to the bulk. For any 
integer D, vertices at distance < D from the root are almost surely distinct when the 
size N of the graph goes to infinity. No short loop, but many long (dashed) ones pass 
through the root. 

variables living on these graphs. For instance, frustration in spin systems emerge from 
the presence of circuits with odd length. The number of these circuits is therefore directly 
related to the amount of glassiness present in the system at low temperature. From the 
dynamical point of view too, the properties of models of interacting or communicating 
agents e.g. routers, ... strongly depend on the topological properties of the underlying 
graph, and particularly upon feedbacks resulting from the presence of circuits. These 
"practical" incentives, together with purely academic motivations have led to recent 
studies on the distributions of unicyclic components [S] and cycles |7j in random graphs. 

Secondly, the absence of short circuits in random graphs or, equivalently, the 
observation that random graphs essentially exhibit a local tree-like structure is crucial 
to the analytical treatment of spin models on random graphs with some common 
techniques, e.g. the replica or cavity methods. These models are characterized by 
(realistic) strong interactions between spins, in contrast to usual mean-field systems, 
e.g. Curie- Weiss or Sherrington-Kirkpatrick models. Yet, the absence of short-ranged 
loops in random graphs make them, around any vertex (root), locally similar to a 
tree surrounded by a remote bulk. Because of that one conjectures that the free- 
energy of a spin model on a random graph is equal to the one on the tree with self- 
consistent boundary conditions requiring that appropriate properties (for example the 
magnetization for the Ising model) are identical on the leaves and at the root vertex 
[HI 13 UH] • One of the goals of this note is to point out that this procedure a la Bethe 
amounts to make assumptions on the large-scale structure of random graphs, i.e. on 
the distribution of long loops§. 

§ This point has certainly already come to mind to researchers in the field but it is, at the best of our 
knowledge, never explicitly mentioned in the literature. 
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We will first discuss loops, and compute their number in the thermodynamic limit by 
analyzing the partition function of the Ising model. Next we will compute the number of 
circuits by discussing the n — > limit of the 0(n) ferromagnetic model. For gathering 
information about the finite N behavior of the number of loops (or of the loop entropy) 
we will use an effective counting algorithm. We will end this note with a discussion of 
our findings and of the (many) open issues. 



2. Infinite size limit: mean-field approach 

In this section, we enumerate long loops in random graphs from the study of associated 
statistical mechanics models. We will give our ad hoc definition of a loop in the following 
section. 



2.1. Loops with multiple crossings 

Let us consider for example Ising spins Si = ±1 on vertices i = 1, . . . , iV of the graph of 
figure HI and ferromagnetic couplings = 1 on edges To calculate the partition 

function Z(j3) of the Ising model at inverse temperature (3 on the graph of figure Q we 
consider the leaves of the uncovered local tree i.e. vertices at distance D from the root 
(in figured the maximum drawn distance is D = 2) [HI El El IIS CHI CHI • At sufficiently 
large (3, a spontaneous, say, positive magnetization m is expected to be present in the 
bulk. As a result, the spins attached to the leaves will feel an external field H > 0. 
Integrating these spins out will in turn produce an external field H' acting on spins at 
distance D — 1 from the root, with ^1] 

H' = ^~ ^ tanh^tanhOS) tanh(/3#)] . (1) 

After repeated iterations of this procedure, the field at the root reaches a stationary 
value, H*, from which we can derive the magnetization m = t&nh\f3cH*] and the free- 
energy density 

f(J3) = -^-ln2(e- /3 + e /3 cosh 2/3iT) + In 2 cosh ( ) . (2) 

2(3 (3 \c — 1 J 

The critical inverse temperature is the smallest value of (3 for which H* is non zero i.e. 
/ 9 c = tanh- 1 (^ I ). 

As is well known, the high temperature expansion of the partition function Z of 
the Ising model can be written as a sum over closed paths going through each vertex 
an even number of times and each edge at most once [Hj. Each path is given a weight 
(tanh/3) L depending upon its length L. In the following we will refer to such paths as 
loops. Gathering all loops with the same weight i.e. same length, we obtain 

Z((3) =2 7V (cosh/5)^^M(L) (tanh/3) L , (3) 
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Figure 2. Entropy a as a function of the length £ of loops (full curves) and circuits 
(dashed curves) for even (A) and odd (B) degrees c (for c = 3, loops and circuits 
coincide). The slope at origin is ln(c — 1) for both cases, the smallest loops being 
essentially circuits. Black dots, with coordinates £+, a + identify the longest loops and 
circuits, see text. 



where M(L) is the number of loops of length L that can be drawn on the graph. It 
is a sensible assumption that this multiplicity exhibits an exponential growth with the 
graph size, 

M(L = £N) = exp[N a(£) + o(N)} , (4) 

where I is the intensive length of the loops, and a is the entropy of loops having length 
I. We stress here that £ = 0(1) corresponds to L — O(N). Knowledge of the entropy a 
will provide us with information about large-scale loops i.e. with lengths of the order 
of N. Insertion of the above scaling hypothesis for M(L) in the partition function Z, 
and use of the Laplace method yield 

-Pf(i3) = - In 2- - In cosh/5 + max [a(£) + £ lntanh/3] (5) 

2 ^ 

in the infinite limit ||. In other words, the free-energy density f(/3) is essentially the 
Legendre transform of the loop entropy a{t). 

We show in figure El our results for the loop entropy. The entropy departs from 
i = o = with a slope equal to — ln(tanh/3 c ) = ln(c — 1) from Its maximum is 

reached in lu = % o~m — (f — 1) In 2, that is, for loops going through half of the edges. 
The left part of the entropy curve (£ < £m) is parametrized by inverse temperatures j3 
going from (3 C (I = - the para/ferro transition takes place when extensive loops start 
contributing to partition function Z) to oo (top of the curve - at zero temperature, Z is 
dominated by the most numerous paths). The right part of the entropy curve [I > Em) 

|| Here we are assuming that not only the free energy density / is self-averaging (as is known and true) 
but that also a enjoys the same property. 

% Note that the finite slope at origin comes from the fact that the objects counted here (loops or 
circuits) are non local; one cannot gain entropy by rearranging edges independently |15| . 
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is obtained when tanh/3 > 1, that is, for inverse temperatures with an imaginary part 
equal to f allowing to transform the hyperbolic tangent of (3 into the cotangent of its 
real part. This is done by considering a real (3 > (3 C , the stationary field H* for this 
temperature, and the transformation (3 — > (3 + i~, {(3H)* — > (f3H)* + i(c — 1)|. 

The case of even degree. For even c a is left unchanged under the transformation 
£ — > | — £. The right part of the entropy curve is thus the mirror symmetric of the left 
part with respect to £ = £m (figure |2K) • This results from a duality between long and 
short extensive loops. Let T F be the full loop (all edges occupied, which is allowed for 
even c). Then, for any loop T with length I < |, T F \ T (that is T F without the edges 
belonging to T) is a loop with length | — t. Notice that the largest loop is T F , with 
length |. 

The case of odd degree. Here duality does not hold and there is no simple 
transformation rule for i and a. An explicit calculation gives the entropy curve shown 
in figure |2f3. The maximal length £ + = ^ c ~^ is reached with an infinite slope, and 
corresponds to a finite entropy a + = |((c — 1) ln(c — 1) — (c — 2) lnc). For odd degrees 
c, indeed, loops cannot occupy all edges since the number of incoming edges onto each 
vertex is even. The longest loops have one free edge per vertex: these act as defects, 
the positions of which can be chosen with some freedom, giving rise to a finite entropy. 
The larger is c, the smaller is the ratio ^j: intuitively, the frustration coming from the 
parity of c is less and less important as c increases" 1 ". 



2.2. Loops without crossings: circuits 

The iteration procedure can be applied to calculate the free-energy of other short-range 
models and then derive the entropies corresponding to large-scale diagrams generated 
through high temperature expansions. For instance the ferromagnetic 0(n) model with 
n — > gives information on circuits i.e loops with vertices having degree 2 at most [16J. 
A spin S is submitted to two fields Hi, H 2 conjugated to the magnetization ^= and its 
squared value*. The iteration equations for these fields read 
{c-l)(3Hi 

1 = 1+ H 2 ' ^ 
H , _ (c-l)(c-2)(3 2 H! 

2 2(1+ H 2 y 

Inserting the fixed point values for the fields in the expression of the free-energy per 
spin component, 



-|jl n [(l + i/ 2 ) 2 + /3fff] ,(7) 



2(l + # 2 ) 2 

+ Numerical investigations of the one-step replica symmetry broken Ansatz for the Ising model with 
tanh/3 > 1 indicate that the replica symmetric solution is correct in this range of (complex- valued) 
temperature |15) . 

* Higher moments are not relevant in the n — > limit. 
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yields (for an alternative derivation, see [T7j). 
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(9) 



is obtained through —j3f(/3) = maxi[a(£) + £ln/3]. Results are shown in figure El The 
maximal entropy, o~m = \{c\n(c — 1) 



The 



(c — 2) ln(c + 1)), is reached in lm — l , • 
1, a + = ln(c— l) + |(c— 2) ln(l — 2/c) corresponds 



rightmost point, with coordinates £ + 
to Hamiltonian cycles. Expression © coincides with the output of rigorous calculations 
[21 E], which shows the exactness of the replica symmetric hypothesis for the 0(n — > 0) 
model Note the similarity of the entropy curves for loops on odd c- regular graphs 
and circuits (figure EJ). In the two cases the slopes at minimal and maximal lengths are 
respectively finite and infinite, see the discussion above. 

Let c > 3 and M(L) be in all the rest of this note the number of circuits of length L 
in a random, c-regular graph. For finite L, M(L) is asymptotically Poisson-distributed 
when N — > oo 



Proba[M(L) 



2L 



-, M 



exp 



(c-r 



2L 



(10) 



The above identity holds indeed for circuit-length L <C log N. The expected number of 



circuits of intensive length 
(M(£)) = { - 



L/N is therefore, for £ < 



logjy 

AT : 



2L 



exp {iVa(£) - log(iV) + a(£)} 



11) 



with cr(£) = £ log(c — 1) and a{£) = \og(2£). Note that this value of a(£) coincides with 
expression (JHJ) at the first order in £. 



3. Finite size corrections to circuit number: numerical results 

To study what happens at finite N we have implemented a fast algorithm for finding 
all circuits in a given graph ^Hj- It is important that we explicitly find, not only 
count, all the circuits so that by our method we can in principle give all interesting 
characterizations. 

In our enumeration we first generate a random graph and then count the circuits. 
We average this outcome over a number of samples. We describe the algorithm for 
enumeration in next section. 

To generate a fixed connectivity random graph we start by assuming that each site 
has c connections that connect it to c different sites: we allow no self-connections and 
no double edges. At the beginning, all connections are free. Two of the connections 
are extracted and matched together. We continue filling them up (we use a table that 
we resize at each step to keep the process effective) till all connections are set or we 
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are stuck because there are two left connections that both belong to the same site or 
that belong to two sites that are already connected. To be sure not to introduce any 
systematic bias in this case we just discard the full graph and restart the procedure 
from scratch. 

3.1. An algorithm for circuit enumeration 

For enumerating circuits we have implemented and used an algorithm introduced by 
Johnson JH]- The algorithm finds all elementary circuits of a graph. The computer 
time needed for this task is bounded by 0((N + E)(M + 1)), where N is the number 
of vertices of the graph, E the number of edges and M the total number of circuits in 
the graph: indeed one proves that the time used between the output of two consecutive 
circuits is bound by 0(N + E) (and that this is true also for time elapse before the 
output of the first circuit and after the output of the last one). The memory needed by 
the algorithm is bounded by 0(N + E). 

Let us just sketch the crucial steps of the procedure. One first orders the vertices 
in some lexicographic sequence, and labels them with integers ranging from to N — 1. 
The search is started from a root vertex r, in the subgraph induced by r and by vertices 
after r: one of the crucial performance issues is that all vertices that become roots are 
the smallest vertex in at least one elementary circuit. The input to the procedure is the 
adjacency structure A(v) for each vertex v, that represents the graph: it contains u if 
and only if (v, u) G £ , where £ is the set of edges of the graph. 

We block a vertex v when it is added to a path beginning in r . We build elementary 
paths starting from r. The vertices of the current trial paths are loaded on a stack. A 
procedure adds the vertex to the path, if appropriate, and appends the vertex to the 
stack: the vertex is deleted from the stack when returning from this procedure. The 
ingenious part of the algorithm is in keeping a vertex blocked as long as possible, to 
minimize the execution time. This has to be done while keeping the procedure correct: 
the basic rule that has to be satisfied to guarantee that all circuits are found (only once) 
is that if it exists a path from the vertex v to r that does not intersect the path loaded 
on the stack, then v has to be free (i.e. it cannot be in a blocked state). One uses a list 
to keep the information needed to satisfy this constraint while staying time effective. 

Some details about performances are as follows: on an Intel Xeon 2.8 GHz processor 
our implementation takes of the order of 0.07 seconds for finding all circuits of a N = 30 
graph (they are 0(50000)), 2.4s for iV = 40 (0(1.5 10 6 ) circuits) and 80s for iV = 50 
(with 0(4 10 7 ) circuits). 

In order to test the results of our code we have also implemented a "quick and 
dirty" backtracking procedure to count Hamiltonian circuits. Since our procedure 
crucially depends on the quality of the random number generator we have also checked 
that different (high quality) random number generators lead to statistically compatible 
answers. 
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Figure 3. Circuit entropy <jn(£) as a function of I for c = 3, and for graph sizes 
ranging from TV = 10 to 64 (from bottom to top). The full curve corresponds to the 
analytical calculation of equation Data for sizes multiple of 10 are made visible 
by using a different drawing style. 



3.2. Results and interpretation 

Thanks to our algorithm and implementation we have been able to enumerate of the 
order of 10 14 circuits (a large number). 

For small c values we can study larger graphs (we have analyzed graphs with up to 
64 vertices in the c = 3 case and up to 22 vertices for c = 6, and averaged our results 
over samples ranging from 1000 to 10000 random graphs). Typically we find for example 
of the order of 300 million circuits on a N = 56, c = 3 graph, one billion circuits on a 
N = 26, c = 5 graph and 1.5 billion circuits on a iV = 22, c = 6 graph. For each value 
of N, we average over of the order of 10000 samples for all the c = 3 enumerations, and 
1000 graphs for c > 3. 

In figure El we plot the theoretical results obtained in the (replica symmetric) 
calculation of Section 2.2 for c = 3, together with results obtained by finite enumeration 
on finite lattices with N vertices. Numerical data from finite graphs are very slowly 
approaching the theoretical, infinite volume data. We try in the following to analyze 
the quality of this asymptotic agreement of the two sets of data. 

At first we know that log(M(£)) ~ £ log(c— 1) as £ — > where (M(£)) is the average 
number of circuits of length L = £ ■ N. With our numerical data we cannot work really 
close to £ = 0, since for finite N we have a value £ m i n that goes to zero as N — > oo: 
finite size effects appear as a flattening of \og(M(£)) when £ becomes very close to the 
minimum allowed value (see figure EJ). One can easily see by eye that the slope is very 
similar to the asymptotic slope in the small £ region where we are relatively safe from 
finite size effects. We have fitted a linear behavior (that is indeed clear in the data) for 
example for £ in the range (.13, .19) for c = 3. 
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Figure 4. N times the difference between the circuit entropy and its asymptotic value, 
as a function of N for different connectivities c. Here I = 0.5. 
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Figure 5. Same as in figure 0] but for Hamiltonian circuits i.e. 1=1. 

Using this approach we find for c from 3 to 6 slopes about 20% smaller than the 
theoretical prediction (on the larger graphs we can study): for c = 3 we find 0.54 versus 
a theoretical log 2 ~ 0.69; for c = 4 we find 0.87 versus 1.10; for c = 5 we find 1.12 versus 
1.39; for c = 6 we find 1.31 versus 1.61. Finite size effect can be drastically reduced if 
we compare directly different c value (since we are using graphs of a size that is limited 
by the same criterion for each c value). For example the ratio of the slope of c and c + 1 
is 0.62 for c = 3 versus a theoretical 0.63, 0.78 versus 0.79 for c = 4 and 0.85 versus 0.86 
for c = 5. This really remarkable agreement gives us confidence that we have a good 
control over finite size effects. 
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Figure 6. Circuit entropy a{l = 0.5) versus N for c = 3 and best fit to the form flffi . 



Equation (jllj) tells us that the difference between the measured circuit entropy 
ctat(£) and the asymptotic value given by formula (0), once multiplied by N, behaves as 

(o- N (£) - = - logiV + a(£) (12) 

for vanishing small values of £, with a(£) = — log(2£). It is therefore independent of 
c, with a logarithmic dependence upon the graph size N. To check how equation (|T2*j) 
applies to finite values of £, we look first in figure H] at the number of circuits with 
i = 0.5, for different values of N and c (we have harvested our most precise data at 
c = 3). Data indeed show only a very weak dependence upon c, and this dependence 
becomes weaker with increasing c. Data for c = 5 are already indistinguishable from 
the ones for c = 6. 

In figure El we show the same quantity for £ = 1 i.e. for Hamiltonian circuits, that 
pass through all vertices of the random graph. As far as the scaling with c is concerned 
figure El shows that the scaling of Hamiltonian circuits is excellent already at c = 3. We 
will come back later about the fact that scaling property of Hamiltonian circuits turn 
out to be very different from the ones of all other finite £, less dense circuits. 

Inspired by the result obtained for small circuits (JHJ),((I2J) we look for the following 
fit for the circuit entropy for finite values of £, 

logiV 1 

o- N (l) = 0-00(0+01— — + C2J^ ■ (13) 

In figureElwe show our results for c = 3, £ = 0.5. The quality of the best fit to data with 
sizes iV > 30 only is excellent, and is very good agreement with all data with iV > 12. 
The two parameter fit is clearly superior to power law fits. We find that with very good 
accuracy (surely better than one percent) 



Ci = -1 , 
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Figure 7. cr(Z = 1) versus N for c = 3. 



i.e. that even at finite £ the relation (|12jl gives the correct leading corrections. This 
result tells us that for all £ values (maybe excluding £ = 1, see later) we have that the 
average number of circuits of reduced length £ equals 

(M(iN)) = (K(£) + o(l))^—, (14) 

where K(£) is a bounded function of £. For C2, we find values close to 1 e.g. .78 in 
the case of £ = 0.5. Here precision is not as good since this is a sub-leading correction. 
What is clear from our data is that sub-leading corrections to the circuit entropy are of 
the order of 1/N as encoded in formula (|14j) . 

As we have said above the case of Hamiltonian circuits (£ = 1) is exceptional. Finite 
size transient effects are very strong; this is intuitively expected since these circuits fill 
the graph and are deeply affected by its finite size. We show in figure [7| the analogous 
of figure El but for £ — 1. It is clear that the structure of finite size effects is completely 
different. On the contrary we have already explained that we find exactly the same 
behavior for all intermediate £ values: the case £ = 1 appears as isolated. 



4. Conclusions 



To sum up, the absence of small loops in random graphs allows one to argue that the 
free-energy of a spin model defined on the graph is equal to the one on a regular tree 
with a self-consistent external field at boundary (leaves). In turn, this free-energy fully 
determines the distribution of large-scale loops in the random graph. We stress that 
the whole complexity of this cavity procedure is actually hidden in the assumption of 
self-consistency for the field(s) j2D]- Assumptions corresponding to broken symmetry in 
the replica framework fZT\ 12*2*] may be necessary for models with random interactions. 
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Anyhow, the salient feature of the above standard approach is that it predicts global 
thermodynamical quantities from local considerations about the graph only 

We have added to our exact computation, valid in the iV — > oo limit, results from 
exact enumeration at finite N. Thanks to them we have been able to determine precisely 
the behavior of the leading corrections to the thermodynamical behavior (at least for 
circuits with £ < 1: we have found that Hamiltonian circuits have stronger finite size 
corrections and a peculiar finite N behavior. 

It would be very interesting to characterize properties or quantities that can 
adequately be described by a local procedure [23] • The question is however well beyond 
the scope of the present paper, which only shows that large loops are (remarkably) 
among those ones. 
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